On cross-validated Lasso in high dimensions

نویسندگان

چکیده

In this paper, we derive nonasymptotic error bounds for the Lasso estimator when penalty parameter is chosen using K-fold cross-validation. Our imply that cross-validated has nearly optimal rates of convergence in prediction, L2, and L1 norms. For example, show model with Gaussian noise under fairly general assumptions on candidate set values parameter, estimation converges to zero prediction norm slogp/n×log(pn) rate, where n sample size available data, p number covariates s nonzero coefficients model. Thus, achieves fastest possible rate up a small logarithmic factor log(pn), similar conclusions apply both L2 Importantly, our results cover case (potentially much) larger than also allow non-Gaussian noise. paper therefore serves as justification widely spread practice cross-validation method choose estimator.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Cross-Validated Bagged Learning.

Many applications aim to learn a high dimensional parameter of a data generating distribution based on a sample of independent and identically distributed observations. For example, the goal might be to estimate the conditional mean of an outcome given a list of input variables. In this prediction context, bootstrap aggregating (bagging) has been introduced as a method to reduce the variance of...

متن کامل

Cross validation in LASSO and its acceleration

We investigate leave-one-out cross validation (CV) as a determinator of the weight of the penalty term in the least absolute shrinkage and selection operator (LASSO). First, on the basis of the message passing algorithm and a perturbative discussion assuming that the number of observations is sufficiently large, we provide simple formulas for approximately assessing two types of CV errors, whic...

متن کامل

Anger Status and its Dimensions among High School Female Students: A Cross-Sectional Study

Aims: Anger is one of the excitements of human, which, if left out of a balanced level and transformed into aggressive behavior, has many negative effects on all aspects of the health of individuals. Awareness of anger status in adolescent students and its effective factors can be the first step in planning and implementing psychological interventions to control and management of students’ ange...

متن کامل

The lasso, persistence, and cross-validation

During the last fifteen years, the lasso procedure has been the target of a substantial amount of theoretical and applied research. Correspondingly, many results are known about its behavior for a fixed or optimally chosen smoothing parameter (given up to unknown constants). Much less, however, is known about the lasso’s behavior when the smoothing parameter is chosen in a data dependent way. T...

متن کامل

The Culture, Intercultural and Cross-cultural Dimensions in Communication

Culture as the philosophy of life refers to the values, norms and rules, and actual behaviorwhich is taken over by man from the past generations, and to leave it to next generation in a differentform, separates individuals belonging to the culture from individuals belonging to other cultures.Each of these different attitudes describes the degree to which the culture values the past, the present...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Annals of Statistics

سال: 2021

ISSN: ['0090-5364', '2168-8966']

DOI: https://doi.org/10.1214/20-aos2000